User interface methods and apparatus for use in communicating text and photo messages

ABSTRACT

Techniques for use in messaging from a portable communication device having a camera module are described. In an instant communication session, the portable device displays a message thread involving two or more participants and a text input field for entering text. In response to an input to capture an image, the portable device automatically captures a photographic image via the camera module, attaches the photographic image to a message, and sends the message to at least one of the two or more participants.

BACKGROUND

1. Field of the Technology

The present disclosure relates generally to messaging with use ofportable communication devices, and more particularly to user interfacetechniques for use in communicating text and photo messages from mobilecommunication devices which communicate in wireless communicationnetworks.

2. Description of the Related Art

Portable communication devices, such as wireless communication devicesoperating in wireless communication networks, include capabilities whichinclude voice telephony and messaging. The messaging may include textmessaging, such as short message service (SMS) messaging or multimediamessaging service (MMS) messaging, electronic-mail (e-mail) messaging,instant messaging, messaging in chat sessions, as a few examples.

These devices may also include camera modules for capturing photographicimages. In some approaches, messaging functions and photo functions areprovided as separate applications or processes, where the features ofone function are accessible from the other function. Here, theprocessing steps involved typically disrupt the natural flow formessaging for the end user, options are limited, and the communicationexperience may be cumbersome and inefficient. For example, the end usermay initiate a camera application, take a picture, and save the picturein device memory. Subsequently, the end user may access a menu forselecting a messaging function, attach the picture to a message, andsend the message using the messaging function. On the other hand, forexample, the end user may initiate a messaging application and compose amessage. If the end user desires to send a picture in the message, theend user may then access a menu for invoking the camera application andthen take a picture. Subsequently, the end user will attach the pictureto the message and send it.

What are needed are methods and apparatus to overcome these and relatedor similar deficiencies of the prior art. The same or similar problemsmay exist with other types of features and functionality.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of present disclosure will now be described by way ofexample with reference to attached figures, wherein:

FIG. 1 is a schematic block diagram of a communication system whichincludes a portable communication device, which may be a wirelesscommunication device which operates for communication in a wirelesscommunication network;

FIG. 2 is a more detailed example of the wireless communication deviceof FIG. 1;

FIG. 3 is a particular structure of a system for data packetcommunications for the wireless communication device of FIGS. 1-2;

FIG. 4 is a flowchart for describing a user interface method for use incommunicating text and photo messages with the wireless communicationdevice of FIGS. 1-3; and

FIGS. 5-16 are display presentations in a display of the wirelesscommunication device for depicting various actions associated with themethod described in relation to the flowchart of FIG. 4, with FIGS. 5-9corresponding to messaging in a non-instant communication mode, andFIGS. 10-16 corresponding to messaging in an instant communication mode.

DETAILED DESCRIPTION OF THE EMBODIMENTS

User interface methods and apparatus for use in communicating text andphoto messages from a portable communication device are describedherein. In an instant communication mode, the portable communicationdevice presents a conversation thread of a message conversationinvolving one or more participants. A text input field for entering textfor the message conversation is also presented. In response to detectingan actuation of a send or enter key, the device sends to the one or moreparticipants a message which includes the text from the text inputfield. On the other hand, in response to detecting an actuation of acamera shutter key, the device performs an automatic multi-step processwhich includes capturing a photographic image with a camera module,attaching the photographic image to a message, and sending to the one ormore participants the message which includes the attached photographicimage. A camera preview mode and user input prompts (e.g. for saving,confirming, etc.) may be suppressed during this process. On the otherhand, in a non-instant communication mode, in response to detecting anactuation of the camera shutter key, the device performs a multi-stepprocess which includes capturing a photographic image with the cameramodule and attaching the photographic image to a message, withoutsending the message. Even further, in a voice call mode where a voicecall is maintained with a voice call participant via the wirelessnetwork, in response to detecting an actuation of the camera shutterkey, the device performs an automatic multi-step process which includescapturing a photographic image with the camera module, attaching thephotographic image to a message, and sending to the voice callparticipant the message which includes the attached photographic image.

To illustrate one exemplary environment within which the presenttechniques may be practiced, FIG. 1 is a block diagram of acommunication system 100 which includes a portable communication device,which is wireless communication device 102 which communicates through awireless communication network 104. Wireless communication device 102may include a display 112, a keyboard 114, and one or more auxiliaryuser interfaces (UI) 116, and a camera module 150, each of which iscoupled to a controller 106. Controller 106 is also coupled to radiofrequency (RF) transceiver circuitry 108 and an antenna 110.

In most modern communication devices, controller 106 is embodied as acentral processing unit (CPU) which runs operating system software in amemory component (not shown). Controller 106 normally controls overalloperation of wireless device 102, whereas signal processing operationsassociated with communication functions are typically performed in RFtransceiver circuitry 108. Controller 106 interfaces with device display112 to display received information, stored information, input requests,and the like. Keyboard 114, which may be a telephone type keypad or fullalphanumeric keyboard, is normally provided for entering data forstorage in wireless device 102, information for transmission to network104, a telephone number to place a telephone call, commands to beexecuted on wireless device 102, and possibly other or different inputrequests. In one embodiment, keyboard 114 may be or include a physicalkeyboard or a virtual or “soft” keyboard, implemented, for example, byway of images of keys rendered on a touch screen display.

Wireless device 102 sends communication signals to and receivescommunication signals from network 104 over a wireless link via antenna110. RF transceiver circuitry 108 performs functions similar to those ofbase station 138, including for example modulation/demodulation andpossibly encoding/decoding and encryption/decryption. It is alsocontemplated that RF transceiver circuitry 108 may perform certainfunctions in addition to those performed by base station 138. It will beapparent to those skilled in art that RF transceiver circuitry 108 willbe adapted to particular wireless network or networks in which wirelessdevice 102 is intended to operate.

Wireless device 102 includes a battery interface 118 for receiving oneor more rechargeable batteries 120. Battery 120 provides electricalpower to (most if not all) electrical circuitry in wireless device 102,and battery interface 118 provides for a mechanical and electricalconnection for battery 120. Battery interface 118 is coupled to aregulator 122 which regulates power for the device. When wireless device102 is fully operational, an RF transmitter of RF transceiver circuitry108 is typically keyed or turned on only when it is sending to network104, and is otherwise turned off to conserve resources. Suchintermittent operation of transmitter has a dramatic effect on powerconsumption of wireless device 102. Similarly, an RF receiver of RFtransceiver circuitry 108 is typically periodically turned off toconserve power until it is needed to receive signals or information (ifat all) during designated time periods.

Wireless device 102 may consist of a single unit, such as a datacommunication device, a cellular telephone, a multiple-functioncommunication device with data and voice communication capabilities suchas a mobile telephone with data communication functionality, a personaldigital assistant (PDA) enabled for wireless communication, a tabletcomputing device, or a computer incorporating an internal modem.Alternatively, wireless device 102 may be a multiple-module unitcomprising a plurality of separate components, including but in no waylimited to a computer or other device connected to a wireless modem. Inparticular, for example, in the wireless device block diagram of FIG. 1,RF transceiver circuitry 108 and antenna 110 may be implemented as aradio modem unit that may be inserted into a port on a laptop computer.In this case, the laptop computer would include display 112, keyboard114, one or more auxiliary UIs 116, and controller 106 embodied as thecomputer's CPU. It is also contemplated that a computer or otherequipment not normally capable of wireless communication may be adaptedto connect to and effectively assume control of RF transceiver circuitry108 and antenna 110 of a single-unit device such as one of thosedescribed above. Such a wireless device 102 may have a more particularimplementation as described later in relation to wireless device 202 ofFIG. 2.

Wireless device 102 may operate using a Subscriber Identity Module (SIM)126 which is connected to or inserted in wireless device 102 at a SIMinterface 124. SIM 126 is one type of a conventional “smart card” usedto identify an end user (or subscriber) of wireless device 102 and topersonalize the device, among other things. Without SIM 126, thewireless device terminal is not fully operational for communicationthrough wireless network 104. By inserting SIM 126 into wireless device102, an end user can have access to any and all of his/her subscribedservices. In order to identify the subscriber, SIM 126 contains someuser parameters such as an International Mobile Subscriber Identity(IMSI) and a Mobile Station Integrated International Service DigitalNetwork (MSISDN). In addition, SIM 126 is typically protected by afour-digit Personal Identification Number (PIN) which is stored thereinand known only by the end user. An advantage of using SIM 126 is thatend users are not necessarily bound by any single physical wirelessdevice. Typically, the only element that personalizes a wireless deviceterminal is a SIM card. Therefore, the user can access subscribedservices using any wireless device equipped to operate with the user'sSIM.

Some information stored on SIM 126 (e.g., address book and SMS messages)may be retrieved and visually displayed on display 112. Wireless device102 has one or more software applications which are executed bycontroller 106 to facilitate the information stored on SIM 126 to bedisplayed on display 112. Controller 106 and SIM interface 124 have dataand control lines 144 coupled therebetween to facilitate the transfer ofthe information between controller 106 and SIM interface 124 so that theinformation may be visually displayed. An end user enters input requestsat keyboard 114, for example, and in response, controller 106 controlsSIM interface 124 and SIM 126 to retrieve the information for display.The end user may also enter input requests at keyboard 114, for example,and, in response, controller 106 controls SIM interface 124 and SIM 126to store information on SIM 126 for later retrieval and viewing. Thesoftware applications executed by controller 106 may include anapplication to retrieve and display address book information stored onSIM 126, and an application to retrieve and display SMS messageinformation stored on SIM 126.

Wireless device 102 communicates in and through wireless communicationnetwork 104. In the embodiment of FIG. 1, wireless network 104 is aGlobal Systems for Mobile (GSM) and General Packet Radio Service (GPRS)network. Wireless network 104 includes a base station 138 with anassociated antenna tower 136, a Mobile Switching Center (MSC) 140, aVisitor Location Register (VLR) 130, a Home Location Register (HLR) 132,and a Short Message Service Center (SMS-SC) 128. MSC 140 is coupled tobase station 138 and to SMS-SC 128, which is in turn coupled to othernetwork(s) 134.

Base station 138, including its associated controller and antenna tower136, provides wireless network coverage for a particular coverage areacommonly referred to as a “cell”. Base station 138 transmitscommunication signals to and receives communication signals fromwireless devices within its cell via antenna tower 136. Base station 138normally performs such functions as modulation and possibly encodingand/or encryption of signals to be transmitted to the wireless device inaccordance with particular, usually predetermined, communicationprotocols and parameters, under control of its controller. Base station138 similarly demodulates and possibly decodes and decrypts, ifnecessary, any communication signals received from wireless device 102within its cell. Communication protocols and parameters may vary betweendifferent networks. For example, one network may employ a differentmodulation scheme and operate at different frequencies than othernetworks.

The wireless link shown in communication system 100 of FIG. 1 representsone or more different channels, typically different radio frequency (RF)channels, and associated protocols used between wireless network 104 andwireless device 102. Those skilled in art will appreciate that awireless network in actual practice may include hundreds of cells, eachserved by a distinct base station 138 and transceiver, depending upondesired overall expanse of network coverage. All base stationcontrollers and base stations may be connected by multiple switches androuters (not shown), controlled by multiple network controllers.

For all wireless devices 102 registered with a network operator,permanent data (such as wireless device 102 user's profile) as well astemporary data (such as wireless device's 102 current location) arestored in HLR 132. In case of a voice call to wireless device 102, HLR132 is queried to determine the current location of wireless device 102.VLR 130 is responsible for a group of location areas and stores the dataof those wireless devices that are currently in its area ofresponsibility. This includes parts of the permanent wireless devicedata that have been transmitted from HLR 132 to VLR 130 for fasteraccess. However, VLR 130 may also assign and store local data, such astemporary identifications. Optionally, VLR 130 can be enhanced for moreefficient co-ordination of GPRS and non-GPRS services and functionality(e.g., paging for circuit-switched calls, and combined GPRS and non-GPRSlocation updates).

Being part of the GPRS network, a Serving GPRS Support Node (SGSN) is atthe same hierarchical level as MSC 140 and keeps track of the individuallocations of wireless devices. An SGSN also performs security functionsand access control. Further, a Gateway GPRS Support Node (GGSN) providesinterworking with external packet-switched networks and is connectedwith SGSNs via an IP-based GPRS backbone network. The SGSN performsauthentication and cipher setting procedures based on the samealgorithms, keys, and criteria as in existing GSM. For SMS transfer overGPRS, the SGSN is used in place of MSC 140.

In order to access GPRS services, wireless device 102 first makes itspresence known to wireless network 104 by performing what is known as aGPRS “attach”. This operation establishes a logical link betweenwireless device 102 and the SGSN and makes wireless device 102 availableto receive, for example, pages via SGSN, notifications of incoming GPRSdata, or SMS messages over GPRS. In order to send and receive GPRS data,wireless device 102 assists in activating the packet data address thatit wants to use. This operation makes wireless device 102 known to theGGSN; interworking with external data networks can thereafter commence.User data may be transferred transparently between wireless device 102and the external data networks using, for example, encapsulation andtunneling. Data packets are equipped with GPRS-specific protocolinformation and transferred between wireless device 102 and the GGSN.

SMS makes use of SMS-SC 128 which acts as a store-and-forward system forrelaying short messages. Messages are stored in the network until thedestination device becomes available, so a user can receive or transmitan SMS message at any time, whether a voice call is in progress or not.SMS-SC 128 may be integrated with a Gateway MSC for Short MessageService (SMS-GMSC) and an Interworking MSC for Short Message Service(SMS-IWMSC), as would be the case shown in FIG. 1. An SMS-GMSC is afunction for receiving a short message from an SMS-SC, interrogating anHLR for routing information and SMS info, and delivering the shortmessage for the recipient MS. An SMS-IWMSC is a function for receiving ashort message from within the network and submitting it to the recipientSMS-SC. Other messages which may be delivered are Multimedia MessagingService (MMS) messages. The above configuration may be provided insubstantial accordance with 3^(rd) Generation Partnership Project,Technical Specification 03.40, V6.2.0, 2001-12 (Release 1997) (3GPP TS03.40).

As apparent from the above, the wireless network includes fixed networkcomponents including RF transceivers, amplifiers, base stationcontrollers, network servers, and servers connected to network. Thoseskilled in art will appreciate that a wireless network may be connectedto other systems, possibly including other networks, not explicitlyshown in FIG. 1.

FIG. 2 is a more detailed block diagram of an exemplary wirelesscommunication device 202. Wireless device 202 may be a two-waycommunication device having at least voice and data communicationcapabilities, including the capability to communicate with othercomputer systems. Depending on the functionality provided, wirelessdevice 202 may be referred to as a mobile station, a user equipment, adata messaging device, a two-way pager, a cellular telephone with datamessaging capabilities, a wireless Internet appliance, or a datacommunication device (with or without telephony capabilities).

If wireless device 202 is enabled for two-way communication, wirelessdevice 202 will normally incorporate a communication subsystem 211,which includes a receiver 212, a transmitter 214, and associatedcomponents, such as one or more (e.g., embedded or internal) antennaelements 216 and 218, local oscillators (LOs) 213, and a processingmodule such as a digital signal processor (DSP) 220. Communicationsubsystem 211 is analogous to RF transceiver circuitry 108 and antenna110 shown in FIG. 1. As will be apparent to those skilled in field ofcommunications, particular design of communication subsystem 211 dependson the communication network in which wireless device 202 is intended tooperate.

Network access requirements will also vary depending upon type ofnetwork utilized. In GPRS networks, for example, network access isassociated with a subscriber or user of wireless device 202. A GPRSdevice therefore operates in conjunction with a Subscriber IdentityModule, commonly referred to as a “SIM” card 256, in order to operate onthe GPRS network. Without such a SIM card 256, a GPRS device will not befully functional. Local or non-network communication functions (if any)may be operable, but wireless device 202 will be unable to carry out anyfunctions involving communications over the network. SIM 256 includesthose features described in relation to FIG. 1.

Wireless device 202 may send and receive communication signals over thenetwork after required network registration or activation procedureshave been completed. Signals received by antenna 216 through the networkare input to receiver 212, which may perform such common receiverfunctions as signal amplification, frequency down conversion, filtering,channel selection, and like, and in the example shown in FIG. 2,analog-to-digital (A/D) conversion. A/D conversion of a received signalallows more complex communication functions such as demodulation anddecoding to be performed in DSP 220. In a similar manner, signals to betransmitted are processed, including modulation and encoding, forexample, by DSP 220. These DSP-processed signals are input totransmitter 214 for digital-to-analog (D/A) conversion, frequency upconversion, filtering, amplification and transmission over communicationnetwork via antenna 218. DSP 220 not only processes communicationsignals, but also provides for receiver and transmitter control. Forexample, the gains applied to communication signals in receiver 212 andtransmitter 214 may be adaptively controlled through automatic gaincontrol algorithms implemented in DSP 220.

Wireless device 202 includes a microprocessor 238 (which is oneimplementation of controller 106 of FIG. 1) which controls overalloperation of wireless device 202. Communication functions, including atleast data and voice communications, are performed through communicationsubsystem 211. Microprocessor 238 also interacts with additional devicesubsystems such as a camera module 280, a display 222, a flash memory224, a random access memory (RAM) 226, auxiliary input/output (I/O)subsystems 228, a serial port 230, a keyboard 232, a speaker 234, amicrophone 236, a short-range communications subsystem 240, and anyother device subsystems generally designated at 242. Data and controllines 260 extend between SIM interface 254 and microprocessor 238 forcommunicating data therebetween and for control. Some of the subsystemsshown in FIG. 2 perform communication-related functions, whereas othersubsystems may provide “resident” or on-device functions. Notably, somesubsystems, such as keyboard 232 and display 222, for example, may beused for both communication-related functions, such as entering a textmessage for transmission over a communication network, anddevice-resident functions such as a calculator or task list. Cameramodule 280 is for use in capturing photographic images through a cameralens of the device.

Operating system software used by microprocessor 238 may be stored in apersistent store such as flash memory 224, which may alternatively be aread-only memory (ROM), a battery backed-up RAM, or similar storageelement (not shown). Those skilled in the art will appreciate that theoperating system, specific device applications, or parts thereof, may betemporarily loaded into a volatile store such as RAM 226.

Microprocessor 238, in addition to its operating system functions,enables execution of software applications on wireless device 202. Apredetermined set of applications which control basic device operations,including at least data and voice communication applications (such as auser interface technique), will normally be installed on wireless device202 during its manufacture. One exemplary application that may be loadedonto wireless device 202 may be a personal information manager (PIM)application having the ability to organize and manage data itemsrelating to a user such as, but not limited to, e-mail, calendar events,voice mails, appointments, and task items. Naturally, one or more memorystores are available on wireless device 202 and SIM 256 to facilitatestorage of PIM data items and other information.

The PIM application has the ability to send and receive data items viathe wireless network. In an exemplary embodiment, PIM data items areseamlessly integrated, synchronized, and updated via the wirelessnetwork, with the wireless device user's corresponding data items storedand/or associated with a host computer system thereby creating amirrored host computer on wireless device 202 with respect to suchitems. This is especially advantageous where the host computer system isthe wireless device user's office computer system. Additionalapplications may also be loaded onto wireless device 202 throughnetwork, an auxiliary I/O subsystem 228, serial port 230, short-rangecommunications subsystem 240, or any other suitable subsystem 242, andinstalled by a user in RAM 226 or a non-volatile store for execution bymicroprocessor 238. Such flexibility in application installationincreases the functionality of wireless device 202 and may provideenhanced on-device functions, communication-related functions, or both.For example, secure communication applications may enable electroniccommerce functions and other such financial transactions to be performedusing wireless device 202.

In a data communication mode, data such as an SMS message will beprocessed by communication subsystem 211 and input to microprocessor238. Microprocessor 238 may further process the signal for output todisplay 222 or alternatively to auxiliary I/O device 228. A user ofwireless device 202 may also compose data items, such as SMS messages,using keyboard 232 in conjunction with display 222 and possiblyauxiliary I/O device 228. Keyboard 232 may be a complete alphanumerickeyboard and/or telephone-type keypad. In one embodiment, keyboard 232may be or include a physical keyboard or a virtual or “soft” keyboard,implemented, for example, by way of images of keys rendered on a touchscreen display. The composed items may be transmitted over acommunication network through communication subsystem 211.

For voice communications, the overall operation of wireless device 202is substantially similar, except that the received signals are output tospeaker 234 and signals for transmission are generated by microphone236. Alternative voice or audio I/O subsystems, such as a voice messagerecording subsystem, may also be implemented on wireless device 202.Although voice or audio signal output may be accomplished primarilythrough speaker 234, display 222 may also be used to provide anindication of the identity of a calling party, duration of a voice call,or other voice call related information, as some examples.

Serial port 230 in FIG. 2 is normally implemented in a personal digitalassistant (PDA)-type communication device for which synchronization witha user's desktop computer is a desirable, albeit optional, component.Serial port 230 enables a user to set preferences through an externaldevice or software application and extends the capabilities of wirelessdevice 202 by providing for information or software downloads towireless device 202 other than through a wireless communication network.The alternate download path may, for example, be used to load anencryption key onto wireless device 202 through a direct and thusreliable and trusted connection to thereby provide secure devicecommunication.

Short-range communications subsystem 240 of FIG. 2 is an additionaloptional component which provides for communication between wirelessdevice 202 and different systems or devices, which need not necessarilybe similar devices. For example, subsystem 240 may include an infrareddevice and associated circuits and components, a Bluetooth™communication module, or an 802.11 communication module, to provide forcommunication with similarly-enabled systems and devices. Bluetooth™ isa registered trademark of Bluetooth SIG, Inc. Those skilled in the artwill appreciate that “Bluetooth” and “802.11” refer to sets ofspecifications, available from the Institute of Electrical andElectronics Engineers (IEEE), relating to wireless personal areanetworks and wireless local area networks, respectively.

Wireless device 202 also includes a battery interface (such as thatdescribed in relation to FIG. 1) for receiving one or more rechargeablebatteries. Such a battery provides electrical power to most if not allelectrical circuitry in wireless device 202, and the battery interfaceprovides for a mechanical and electrical connection for it. The batteryinterface is coupled to a regulator which regulates a voltage to all ofthe circuitry.

FIG. 3 shows a particular system architecture for communicating with awireless communication device. In particular, FIG. 3 shows basiccomponents of an IP-based wireless data network, such as a GPRS network.Wireless device 202 communicates with a wireless packet data network345, and may also be capable of communicating with a wireless voicenetwork (not shown). The voice network may be associated with theIP-based wireless network as similar to, for example, GSM and GPRSnetworks, or alternatively may be a completely separate network. TheGPRS IP-based data network is unique in that it is effectively anoverlay on the GSM voice network. As such, GPRS components will eitherextend existing GSM components, such as base stations 320, or requireadditional components to be added, such as an advanced Gateway GPRSService Node (GGSN) as a network entry point 305. Such networkarchitecture may facilitate the communication of data messages, such asmultimedia messaging service (MMS) messages.

As shown in FIG. 3, a gateway 340 may be coupled to an internal orexternal address resolution component 335 and one or more network entrypoints 305. Data packets are transmitted from gateway 340, which issource of information to be transmitted to wireless device 202, throughwireless network 345 by setting up a wireless network tunnel 325 fromgateway 340 to wireless device 202. In order to create this wirelesstunnel 325, a unique network address is associated with wireless device202. In an IP-based wireless network, however, network addresses aretypically not permanently assigned to a particular wireless device 202but instead are dynamically allocated on an as-needed basis. Thus,wireless device 202 may acquire a network address and for gateway 340 todetermine this address so as to establish wireless tunnel 325.

Network entry point 305 is generally used to multiplex and demultiplexamongst many gateways, corporate servers, and bulk connections such asthe Internet, for example. There are normally very few of these networkentry points 305, since they are also intended to centralize externallyavailable wireless network services. Network entry points 305 often usesome form of an address resolution component 335 that assists in addressassignment and lookup between gateways and wireless devices. In thisexample, address resolution component 335 is shown as a dynamic hostconfiguration protocol (DHCP) server as one method for providing anaddress resolution mechanism.

A central internal component of wireless data network 345 is a networkrouter 315. Normally, network routers 315 are proprietary to theparticular network, but they could alternatively be constructed fromstandard commercially available hardware. The purpose of network routers315 is to centralize a plurality (e.g., thousands) of base stations 320normally implemented in a relatively large network into a centrallocation for a long-haul connection back to network entry point 305. Insome networks there may be multiple tiers of network routers 315 andthere may be cases where there are master and slave network routers 315,but in all such cases the functions of network routers 315 are similar.Often network router 315 will access a name server 307, in this caseshown as a dynamic name server (DNS) 307 as used in the Internet, tolook up destinations for routing data messages. Base stations 320, asdescribed above, provide wireless links to wireless devices such aswireless device 202.

Wireless network tunnels such as a wireless tunnel 325 are opened acrosswireless network 345 in order to allocate necessary memory, routing, andaddress resources to deliver IP packets. In GPRS, such tunnels 325 areestablished as part of what are referred to as “PDP contexts” (i.e.,data sessions). To open wireless tunnel 325, wireless device 202 may usea specific technique associated with wireless network 345. The step ofopening such a wireless tunnel 325 may require wireless device 202 toindicate the domain, or network entry point 305 with which it wishes toopen wireless tunnel 325. In this example, the tunnel first reachesnetwork router 315 which uses name server 307 to determine which networkentry point 305 matches the domain provided. Multiple wireless tunnelscan be opened from one wireless device 202 for redundancy, or to accessdifferent gateways and services on the network. Once the domain name isfound, the tunnel is then extended to network entry point 305 andnecessary resources are allocated at each of the nodes along the way.Network entry point 305 then uses address resolution component 335(e.g., DHCP server 335) to allocate an IP address for wireless device202. When an IP address has been allocated to wireless device 202 andcommunicated to gateway 340, information can then be forwarded fromgateway 340 to wireless device 202.

Wireless tunnel 325 typically has a limited life, depending on wirelessdevice's 202 coverage profile and activity. Wireless network 345 willtear down wireless tunnel 325 after a certain period of inactivity orout-of-coverage period, in order to recapture resources held by thiswireless tunnel 325 for other users. The main reason for this is toreclaim the IP address temporarily reserved for wireless device 202 whenwireless tunnel 325 was first opened. Once the IP address is lost andwireless tunnel 325 is torn down, gateway 340 loses all ability toinitiate IP data packets to wireless device 202, whether overTransmission Control Protocol (TCP) or over User Datagram Protocol(UDP).

In the present disclosure, an IP-based wireless network (which is onespecific type of wireless communication network) may include but is notlimited to a Code Division Multiple Access (CDMA) network that has beendeveloped and operated by Qualcomm; a General Packet Radio Service(GPRS) network for use in conjunction with Global System for MobileCommunications (GSM) network both developed by standards committee ofEuropean Conference of Postal and Telecommunications Administrations(CEPT); third-generation (3G) networks like Enhanced Data rates for GSMEvolution (EDGE) and Universal Mobile Telecommunications System (UMTS);3GPP Long Term Evolution (EDGE) networks; fourth-generation (4G)networks; and so on. It is to be understood that although particularIP-based wireless networks have been described, techniques of thepresent disclosure could be utilized in any suitable type of wirelessnetwork. Note that the infrastructure shown and described in relation toFIG. 3 may be representative of each one of a number of differentcommunication networks which are provided and available in the samegeographic region. One of these communication networks will be selectedby the wireless device, either in an automatic or manual fashion, forcommunications.

With reference back to FIG. 2, as previously described, wireless device202 may include camera module 280 for use in capturing photographicimages through a camera lens of the device. The end user of wirelessdevice 202 may open a camera application. In response to opening of thecamera application, the device will invoke a preview mode of the cameramodule 280. In the preview mode, display 222 of wireless device 202depicts a preview of the intended photographic image to be capturedthrough the camera lens of the device. In response to detecting anactuation of a camera shutter key during the preview mode, the devicecauses a photographic image to be captured with the camera module 280.The device then presents a user input prompt for saving (and/ordeleting) the photographic image in memory. After saving the message,the end user may attach the saved photographic image to a message andsend it from the device.

With conventional techniques, messaging functions and photo functionsare typically provided as separate applications or processes, where thefeatures of one function are accessible from the other function. Notehowever that conventional processing involved in text and photomessaging typically disrupt the natural flow for messaging for the enduser, options are limited, and the communication experience may becumbersome and inefficient.

FIG. 4 is a flowchart for describing an exemplary user interface methodfor use in communicating text and photo messages from a portablecommunication device, such as the wireless communication devicedescribed above in relation to FIGS. 1-3, which overcome deficiencies ofconventional techniques. The techniques described in relation to theflowchart may be performed by one or more controllers or processors ofthe communication device along with its wireless transceiver. A computerprogram product which may embody the technique may include a computerreadable medium (e.g., memory of the communication device, computerdisk, CD-ROM, etc.) having computer instructions stored therein whichare executable by the one or more processors of the device forperforming the technique.

The flowchart of FIG. 4 is related to the presentation shown in FIGS.5-16, which correspond to various blocks of the flowchart as willdescribed later in more detail. In brief, FIGS. 5-9 correspond tomessaging in a “non-instant” communication mode, and FIGS. 10-16correspond to messaging in an “instant” communication mode.

Referring to the flowchart of FIG. 4, and beginning at a start block 402of FIG. 4, the processor identifies which mode of operating/messaging isselected by the end user (block 403 of FIG. 4). The portablecommunication device provides a non-instant communication mode (block404 of FIG. 4) or an instant communication mode (block 422 of FIG. 4).The portable communication device also provides a voice call mode (block442 of FIG. 4), where a voice call is maintained with a voice callparticipant via the wireless network.

In FIG. 4, if the non-instant communication mode of block 404 isidentified (e.g. e-mail or SMS/MMS), the processor operates to present atext input field in the display (block 406 of FIG. 4). The text inputfield is presented for use in entering text in the message to be sent.The processor monitors to detect, via the user interface, text entry(e.g. alphanumeric characters) from the end user (block 408 of FIG. 4).If text is entered at block 408, the processor receives and populatesthe text in the text entry field for the message to be sent (block 410of FIG. 4).

The processor also monitors to detect, via the user interface, an inputrequest corresponding to an actuation of a camera shutter key (block 412of FIG. 4). If the processor detects the input request corresponding tothe actuation of the camera shutter key at block 412, the processorcauses a photographic image to be captured using the camera module(block 416 of FIG. 4) and attached to the message (block 418 of FIG. 4).Here, the photographic image (or an image or thumbnail thereof) ispopulated in the text entry field for presentation in the display.However, in one example, the message is not sent responsive to actuationof the camera shutter key in the non-instant communication mode.Alternatively, the message may be sent responsive to actuation of thecamera shutter key in the non-instant communication mode.

In one embodiment, the process of blocks 416 and 418 suppresses thepreview mode of the camera module. The process of blocks 416 and 418 mayalso refrain from presenting any user input prompts, e.g. a user inputprompt for saving the photographic image, etc.

In the non-instant communication mode, the processor also monitors todetect, via the user interface, an input request corresponding to anactuation of a send/enter key (block 414 of FIG. 4). If the processordetects the input request corresponding to the actuation of thesend/enter key at block 414, the processor causes the message to be sentvia the RF transceiver through the wireless network to the intendedrecipients(s) (block 420 of FIG. 4). The message will include any textentered into the input field from block 410 and any photographic imagecaptured and attached in blocks 416 and 418. The process proceeds backto block 403 as shown, or back to block 404 as an alternative.

On the other hand, if the instant communication mode of block 422 isidentified (e.g. IM or BBM messaging, in connection with an existingmessage conversation or “chat”), the processor operates to present aconversation thread in the display (block 424 of FIG. 4). The processoralso operates to present a text input field in the display (block 426 ofFIG. 4). The text input field is presented for use in entering text inthe message to be sent. The processor monitors to detect, via the userinterface, text entry (e.g. alphanumeric characters) from the end user(block 428 of FIG. 4). If text is entered at block 408, the processorreceives and presents the text in the text input field for the messageto be sent (block 430 of FIG. 4).

The processor also monitors to detect, via the user interface, an inputrequest corresponding to an actuation of the camera shutter key (block432 of FIG. 4). If the processor detects the input request correspondingto the actuation of the camera shutter key at block 432, the processorcauses an automatic multi-step process to be performed. This automaticmulti-step process which is performed by the processor includescapturing a photographic image using the camera module (block 436 ofFIG. 4), attaching the photographic image to the message (block 438 ofFIG. 4), and causing the message to be sent via the RF transceiverthrough the wireless network to the intended recipient(s) (block 440 ofFIG. 4). The message will also include any text entered (i.e. prior toactuation of the camera shutter key) into the text input field fromblock 430. The photographic image and any entered text are presented inthe conversation thread. Any subsequent actuations of the camera shutterkey will repeat this automatic multi-step process.

In the instant communication mode, the processor also monitors todetect, via the user interface, an input request corresponding to anactuation of the send/enter key (block 434 of FIG. 4). If the processordetects the input request corresponding to the actuation of thesend/enter key at block 434, the processor causes the message to be sentvia the RF transceiver through the wireless network to the intendedrecipients(s) (block 420 of FIG. 4). The message will include any textentered into the input field from block 430, and the text is presentedin the conversation thread.

On the other hand, if the voice call mode of block 442 is identified,the processor operates to maintain a voice call via the RF transceiverwith a voice call participant through the wireless network. The voicecall utilizes a radio traffic channel established between the device andthe wireless network. During the voice call, the processor monitors todetect, via the user interface, an input request corresponding to anactuation of the camera shutter key (block 448 of FIG. 4). If theprocessor detects the input request corresponding to the actuation ofthe camera shutter key at block 448, the processor causes an automaticmulti-step process to be performed. The automatic multi-step processincludes capturing a photographic image using the camera module (block448 of FIG. 4), attaching the photographic image to the message (block450 of FIG. 4), and causing the message to be sent via the RFtransceiver through the wireless network to the voice call participant(block 452 of FIG. 4). Here, the process may operate to request andestablish an additional radio traffic channel with the wireless networkin order to send the message having the photographic image to the voicecall participant.

In one embodiment, the message in block 452 is a Multimedia MessagingService (MMS) message. Here, the processor operates to create an MMSmessage, identify the telephone number of the called or calling numberof the voice call participant (i.e. taken from entry or selection of thetelephone number by the end user for establishing the voice call, orthrough a received Caller Identification from the calling party), andpopulate an address recipient field (“TO” field) of the MMS message withthe identified telephone number. In another embodiment, the message inblock 452 is an electronic mail (e-mail) message. Here, the processoroperates to create an e-mail message, select/identify the contactassociated with the telephone number of the voice call participant,populate the address recipient field (“TO” field) of the e-mail messagewith an e-mail address extracted from the contact information of thecontact corresponding to the voice call participant, and send the e-mailmessage. In another variation of block 452, instead of automaticallycausing the message with the photographic image to be sent, theprocessor causes a user input prompt to be presented in the display forend user confirmation to send the message. Here, the processor maypresent the user input prompt for the end user to enter the telephonenumber or e-mail address. Alternatively, the user input prompt mayprovide an option for the user to select between different messagingtypes (e.g. select between MMS and e-mail messaging, as described in theprevious paragraphs) prior to sending the message.

FIGS. 5-9 are illustrative presentations associated with messaging inthe non-instant communication mode, corresponding to blocks 404-420 ofFIG. 4. Referring initially to FIG. 5, a list 502 of message headers ispresented in display 222. The message headers in list 502 correspond topreviously-communicated messages which are stored in memory. Themessages may include messages received at the wireless device, as wellas message sent from the wireless device. The message headers of themessages may be displayed in forward or reverse chronological order fromthe date and time they were received or sent, for example, as shown inFIG. 5.

While the list 502 of message headers is displayed, the user of thewireless device uses an input mechanism of the user interface (e.g., akeyboard, touch screen display, etc.) to navigate through a menu list504 which may be invoked in display 222. Menu list 504 includes aplurality of function indicators 506 corresponding to a plurality ofdifferent functions which may be invoked. Some of function indicators506 correspond to a plurality of different functions associated withmessaging or messaging in connection with specific messages in menu list504.

In the example shown in FIG. 5, function indicators 506 in menu list 504include a “Help” function indicator corresponding to a help function; an“Open” function indicator corresponding to an “open message” function; a“Mark Unopened” function indicator corresponding to a “marked message asunopened” function; an “Clear Chat” function indicator corresponding toa “clear or erase previous chat” function; a “Delete” function indicatorcorresponding to a “delete message” function; a “Compose E-mail”function indicator corresponding to a “create new e-mail message”function; a “Compose PIN” function indicator corresponding to a “createnew PIN message” function; a “Compose SMS/MMS” function indicator 508corresponding to a “create new SMS or MMS message” function; and an“Instant Messaging” function indicator 510 corresponding to a “createnew instant message” function.

The end user may initiate the non-instant communication mode withreference to FIG. 5 by selecting the Compose E-mail function indicatorcorresponding to creating a new e-mail message, or the Compose SMS/MMSfunction indicator 508 corresponding to creating a new SMS/MMS message.On the other hand, the end user may initiate the instant communicationmode by selecting the “Instant Messaging” function indicatorcorresponding to creating a new instant message, by selecting the“Compose PIN” function indicator corresponding to creating a new PINmessage (e.g. BlackBerry Messaging (BBM) messaging or messageconversation), or by selecting the “Open” function indicatorcorresponding to opening a new or existing message conversation or chatof the “instant” type.

For the non-instant communication mode, FIG. 6 shows the user interfacewhich includes display 222 and a plurality of keys 602, where the keysinclude a send (or enter) key 604 and a camera shutter key 606. Inaddition, a presentation for composing a new, non-instant message to besent is shown. A messaging mode indicator 622 which corresponds to thecurrently selected non-instant communication mode (“SMS/MMS messagingmode”) is presented in display 222. A text entry field 610 for enteringtext for the message to the message recipient is also presented indisplay 222 (e.g. block 406 of FIG. 4). A message sent field 612 of thepresentation is left blank, as no message has yet been sent. The messagewill be sent to a message recipient which is indicated by a messagerecipient name or address selected by the end user and provided in amessage recipient field 620.

In FIG. 6 it is shown that alphanumeric characters or text 650 isentered into text entry field 610 (e.g. block 410 of FIG. 4), and acursor 614 is presented at the end of the entered text 640. From FIG. 6,in response to the actuation of the send/enter key 604 (block 414 ofFIG. 4), the message which includes the text 650 is sent via thewireless network to the selected message recipient address (block 420 ofFIG. 4). As a result, the presentation is changed as provided in FIG. 7,where text 650 is populated in message sent field 612 and removed fromtext entry field 610.

On the other hand, and again from FIG. 6, in response to the actuationof the camera shutter key 606 (block 412 of FIG. 4), a photographicimage is captured and therefore text entry field 610 is populated with aview of the captured photographic image in addition to the text 650which was previously entered. At this point, the message has not beensent. The preview mode of the camera module may or may not be suppressedin this mode, and the processor may also refrain from presenting anyuser input prompts (e.g. refrain from presenting a user input prompt forsaving the photographic image, etc.). Immediately following thiscapturing of the image, and in response to the actuation of thesend/enter key 604 (block 414 of FIG. 4), the message which includestext 650 and photographic image 652 is sent via the wireless network tothe selected message recipient address (block 420 of FIG. 4). As aresult, the presentation is changed as provided in FIG. 9, where text650 and photographic image 652 are populated in message sent field 612and removed from text entry field 610.

FIGS. 10-16 are illustrative presentations associated with messaging inthe instant communication mode, corresponding to blocks 403-440 of FIG.4. FIG. 10 shows that the instant messaging mode may be entered, forexample, by selecting the “Instant Messaging” function indicator 510corresponding to the “create new instant message” function, aspreviously described. In FIG. 11, a presentation for communicating inthe instant communication mode is shown. A messaging mode indicator 1102which corresponds to the currently selected instant communication(“Instant Mode”) is presented in display 222. A conversation threadfield 1106 which includes a conversation thread 1110 is presented (e.g.block 424 of FIG. 4). Text entry field 610 for entering text forcomposing a message is also presented in display 222 (e.g. block 426 ofFIG. 4). The message will be sent to one or more participants which areindicated by participant names or addresses provided in a messageparticipants field 1104.

In FIG. 11, it is shown that no text has been added to text entry field610. Subsequently, in FIG. 12 it is shown that alphanumeric charactersor text 650 are entered into text entry field 610 (e.g. block 430 ofFIG. 4), and a cursor 614 remains at the end of the entered text 650.From FIG. 12, and in response to the actuation of the send/enter key 604(e.g. block 434 of FIG. 4), the message which includes text 650 is sentto the one or more participants via the wireless network (e.g. block 440of FIG. 4). As a result, the presentation is changed as provided in FIG.13, where text 650 is populated in conversation thread 1106 and removedfrom text entry field 610. Subsequent actuations of the send/enter key604 with text entered in text input field 610 will cause the sameactions to be repeated.

On the other hand, and from FIG. 11, in response to the actuation of thecamera shutter key 606 (e.g. block 432 of FIG. 4), the automaticmulti-step process is performed where a photographic image is captured,attached to a message, and sent to the one or more participants. As aresult, the presentation is changed as provided in FIG. 14, wherephotographic image 652 (or an image or thumbnail thereof) is populatedin conversation thread 1106. Note that the preview mode of the cameramodule may be suppressed, and the processor may also refrain frompresenting any user input prompts, e.g. a user input prompt for savingthe photographic image, etc. Subsequent actuations of the camera shutterkey 606 will cause the same actions to be repeated.

Even further, and in this case from FIG. 13 where text has been entered,in response to the actuation of the camera shutter key 606 (e.g. block432 of FIG. 4), the automatic multi-step process is performed where aphotographic image is captured, attached to a message which includes theentered text, and sent to the one or more participants (e.g. block 440of FIG. 4). As a result, the presentation is changed as provided in FIG.15, where text 650 and photographic image 652 are populated inconversation thread 1106 and removed from text entry field 610.Subsequent actuations of the camera shutter key 606 with text enteredinto text input field 610 will cause the same actions to be repeated.

Yet even further, and in this case from FIG. 14 where photographic image652 has already been sent, in response to a subsequent actuation ofcamera shutter key 606 (e.g. block 432 of FIG. 4), the automaticmulti-step process is again performed where a photographic image iscaptured, attached to a message, and sent to the one or moreparticipants (e.g. block 440 of FIG. 4). As a result, the presentationis changed as provided in FIG. 16 where an additional photographic image654 (or an image or thumbnail thereof) is populated in conversationthread 1106. Subsequent actuations of the camera shutter key 606 willcause the same actions to be repeated.

The techniques of the present disclosure provide advantages overconventional messaging techniques. The processing involved typicallydisrupt the natural flow for messaging for the end user, options arelimited, and the communication experience may be cumbersome andinefficient.

Thus, user interface methods and apparatus for use in communicating textand photo messages from a portable communication device have beendescribed. In one illustrative example, in an instant communicationsession, the portable device displays a message thread involving two ormore participants and a text input field for entering text. In responseto an input to capture an image, the portable device automaticallycaptures a photographic image via the camera module, attaches thephotographic image to a message, and sends the message to at least oneof the two or more participants.

In another illustrative example, in an instant communication mode, thedevice presents a conversation thread of a message conversationinvolving one or more participants. A text input field for entering textfor the message conversation is also presented. In response to detectingan actuation of a send or enter key, the device sends to the one or moreparticipants a message which includes the text from the text inputfield. On the other hand, in response to detecting an actuation of acamera shutter key, the device performs an automatic multi-step processwhich includes capturing a photographic image with a camera module,attaching the photographic image to a message, and sending to the one ormore participants the message which includes the attached photographicimage. A camera preview mode and user input prompts may be suppressedduring this process. On the other hand, in a non-instant communicationmode, in response to detecting an actuation of the camera shutter key,the device performs a multi-step process which includes capturing aphotographic image with the camera module and attaching the photographicimage to a message, but without sending the message. Even further, in avoice call mode where a voice call is maintained with a voice callparticipant via the wireless network, in response to detecting anactuation of the camera shutter key, the device performs an automaticmulti-step process which includes capturing a photographic image withthe camera module, attaching the photographic image to a message, andsending to the voice call participant the message which includes theattached photographic image.

The above-described embodiments of disclosure are intended to beexamples only. For example, instant communications may involve thecommunication of messages via SMS and/or MMS, where the messagingapplication is configured to present messages with the same participantsin the same conversation thread. Also for example, the camera shuttermay be a hardware key, a soft key, or be invoked by a gesture.Alterations, modifications, and variations may be effected to particularembodiments by those of skill in art without departing from scope ofinvention, which is defined solely by claims appended hereto.

1. A method performed by a portable communication device that includes acamera module, the method comprising: receiving, during presentation ofa messaging user interface, a user input indicating selection of analphanumeric character; presenting, based on the user input, thealphanumeric character in a composition portion of the messaging userinterface; receiving, during presentation of the messaging userinterface and of the alphanumeric character in the composition portion,another user input indicating selection of a camera shutter key; andperforming, in response to the another user input, an automaticmulti-step process of: a) controlling the camera module to capture aphotographic image; b) associating the photographic image with thealphanumeric character; and c) sending the photographic image togetherwith the alphanumeric character.
 2. The method of claim 1, furthercomprising: in response to the another user input, suppressing a previewmode of the camera module.
 3. The method of claim 1, further comprising:refraining from presenting a user input prompt for saving thephotographic image after capturing the photographic image.
 4. The methodof claim 1, wherein the messaging user interface is an e-mail messaginguser interface and wherein sending the photographic image together withthe alphanumeric character comprises sending an email message containingthe photographic image and the alphanumeric character.
 5. The method ofclaim 1, wherein the messaging user interface is a text messaging userinterface and wherein sending the photographic image together with thealphanumeric character comprises sending a Multimedia Messaging Service(MMS) message containing the photographic image and the alphanumericcharacter.
 6. The method of claim 1, wherein the messaging userinterface is an instant messaging user interface.
 7. The method of claim1, wherein the messaging user interface is a non-instant messaging userinterface.
 8. The method of claim 1, wherein the messaging userinterface includes an address field and wherein sending the photographicimage together with the alphanumeric character comprises sending thephotographic image and the alphanumeric character in to an addressprovided in the address field.
 9. The method of claim 1, wherein sendingthe photographic image together with the alphanumeric charactercomprises sending the alphanumeric character and the photographic imagein a single message.
 10. The method of claim 1, wherein sending thephotographic image together with the alphanumeric character comprisessending the photographic image as an attachment to a message thatincludes the alphanumeric character.
 11. The method of claim 1, furthercomprising, displaying the camera shutter key on a display of theportable communications device.
 12. A portable communication device,comprising: one or more processors; a camera module coupled to the oneor more processors; a communication subsystem coupled to one or more ofthe processors; a display coupled to one or more of the processors; aninput mechanism coupled to one or more of the processors; memory coupledto one or more of the processors, the memory includingprocessor-executable instructions which, when executed, cause one ormore of the processors to: receive, during presentation of a messaginguser interface on the display, a user input indicating selection of analphanumeric character; present, based on the user input, thealphanumeric character in a composition portion of the messaging userinterface; receive, during presentation of the messaging user interfaceand of the alphanumeric character in the composition portion, anotheruser input indicating selection of a camera shutter key; and perform, inresponse to the another user input, an automatic multi-step process of:a) controlling the camera module to capture a photographic image; b)associating the photographic image with the alphanumeric character; andc) sending the photographic image together with the alphanumericcharacter.
 13. The portable communication device of claim 12, whereinthe processor executable instructions further configure the processorto, in response to the another user input, suppress a preview mode ofthe camera module.
 14. The portable communication device of claim 12,wherein the processor executable instructions further configure theprocessor to refrain from presenting a user input prompt for saving thephotographic image after capturing the photographic image.
 15. Theportable communication device of claim 12, wherein the messaging userinterface is an e-mail messaging user interface and wherein sending thephotographic image together with the alphanumeric character comprisessending an email message containing the photographic image and thealphanumeric character.
 16. The portable communication device of claim12, wherein the messaging user interface is a text messaging userinterface and wherein sending the photographic image together with thealphanumeric character comprises sending a Multimedia Messaging Service(MMS) message containing the photographic image and the alphanumericcharacter.
 17. The portable communication device of claim 12, whereinthe messaging user interface is an instant messaging user interface. 18.The portable communication device of claim 12, wherein the messaginguser interface is a non-instant messaging user interface.
 19. Theportable communication device of claim 12, wherein the messaging userinterface includes an address field and wherein sending the photographicimage together with the alphanumeric character comprises sending thephotographic image and the alphanumeric character in to an addressprovided in the address field.
 20. A non-transitory computer readablestorage medium having encoded thereon computer-readable instructionsfor: receiving, during presentation of a messaging user interface, auser input indicating selection of an alphanumeric character;presenting, based on the user input, the alphanumeric character in acomposition portion of the messaging user interface; receiving, duringpresentation of the messaging user interface and of the alphanumericcharacter in the composition portion, another user input indicatingselection of a camera shutter key; and performing, in response to theanother user input, an automatic multi-step process of: a) controlling acamera module to capture a photographic image; b) associating thephotographic image with the alphanumeric character; and c) sending thephotographic image together with the alphanumeric character.